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o 

Neurons in the brain represent external stimuli via neural codes. These codes often arise from stereotyped 
stimulus-response maps, associating to each neuron a convex receptive field. An important problem con- 
fronted by the brain is to infer properties of a represented stimulus space without knowledge of the receptive 
fields, using only the instrinsic structure of the neural code. How does the brain do this? To address this 
question, it is important to determine what stimulus space features can - in principle - be extracted from 
i— i neural codes. This motivates us to define the neural ring and a related neural ideal, algebraic objects that 

^) encode the full combinatorial data of a neural code. Our main finding is that these objects can be expressed 

in a "canonical form" that directly translates to a minimal description of the receptive field structure intrin- 
sic to the neural code. We also find connections to Stanley-Reisner rings, and use ideas similar to those in 
the theory of monomial ideals to obtain an algorithm for computing the primary decomposition of pseudo- 
monomial ideals. This allows us to algorithmically extract the canonical form associated to any neural code, 
^ ! providing the groundwork for inferring stimulus space features from neural activity alone. 
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1 Introduction 

Building accurate representations of the world is one of the basic functions of the brain. It is well-known that 
when a stimulus is paired with pleasure or pain, an animal quickly learns the association. Animals also learn, 
however, the (neutral) relationships between stimuli of the same type. For example, a bar held at a 45-degree 
angle appears more similar to one held at 50 degrees than to a perfectly vertical one. Upon hearing a triple of 
distinct pure tones, one seems to fall "in between" the other two. An explored environment is perceived not as 
a collection of disjoint physical locations, but as a spatial map. In summary, we do not experience the world 
as a stream of unrelated stimuli; rather, our brains organize different types of stimuli into highly structured 
stimulus spaces. 

The relationship between neural activity and stimulus space structure has, nonetheless, received remarkably 
little attention. In the field of neural coding, much has been learned about the coding properties of individual 
neurons by investigating stimulus-response functions, such as place fields [TJ [2], orientation tuning curves [3111], 
and other examples of "receptive fields" obtained by measuring neural activity in response to experimentally- 
controlled stimuli. Moreover, numerous studies have shown that neural activity, together with knowledge of the 
appropriate stimulus-response functions, can be used to accurately estimate a newly presented stimulus [21 [HI [7] ■ 
This paradigm is being actively extended and revised to include information present in populations of neurons, 
spurring debates on the role of correlations in neural coding [SJ GO HHj- In each case, however, the underlying 
structure of the stimulus space is assumed to be known, and is not treated as itself emerging from the activity 
of neurons. This approach is particularly problematic when one considers that the brain does not have access to 
stimulus-response functions, and must represent the world without the aid of dictionaries that lend meaning to 
neural activity In coding theory parlance, the brain does not have access to the encoding map, and must 
therefore represent stimulus spaces via the intrinsic structure of the neural code. 

How does the brain do this? In order to eventually answer this question, we must first tackle a simpler one: 

Question: What can be inferred about the underlying stimulus space from neural activity alone? I.e., what 
stimulus space features are encoded in the intrinsic structure of the neural code, and can thus be extracted 
without knowing the individual stimulus-response functions? 

Recently we have shown that, in the case of hippocampal place cell codes, certain topological features of the 
animal's environment can be inferred from the neural code alone, without knowing the place fields As 
will be explained in the next section, this information can be extracted from a simplicial complex associated to 
the neural code. What other stimulus space features can be inferred from the neural code? For this, we turn 
to algebraic geometry. Algebraic geometry provides a useful framework for inferring geometric and topological 
characteristics of spaces by associating rings of functions to these spaces. All relevant features of the underlying 
space are encoded in the intrinsic structure of the ring, where coordinate functions become indeterminates, and 
the space itself is defined in terms of ideals in the ring. Inferring features of a space from properties of functions 
- without specified domains - is similar to the task confronted by the brain, so it is natural to expect that this 
framework may shed light on our question. 

In this article we introduce the neural ring, an algebro-geometric object that can be associated to any 
combinatorial neural code. Much like the simplicial complex of a code, the neural ring encodes information about 
the underlying stimulus space in a way that discards specific knowledge of receptive field maps, and thus gets 
closer to the essence of how the brain might represent stimulus spaces. Unlike the simplicial complex, the neural 
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ring retains the full combinatorial data of a neural code, packaging this data in a more computationally tractable 
manner. We find that this object, together with a closely related neural ideal, can be used to algorithmically 
extract a compact, minimal description of the receptive field structure dictated by the code. This enables us to 
more directly tie combinatorial properties of neural codes to features of the underlying stimulus space, a critical 
step towards answering our motivating question. 

Although the use of an algebraic construction such as the neural ring is quite novel in the context of 
neuroscience, the neural code (as we define it) is at its core a combinatorial object, and there is a rich tradition of 
associating algebraic objects to combinatorial ones [12] . The most well-known example is perhaps the Stanley- 
Reisner ring [T3], which turns out to be closely related to the neural ring. Within mathematical biology, 
associating polynomial ideals to combinatorial data has also been fruitful. Recent examples include inferring 
wiring diagrams in gene-regulatory networks [TH [TS] and applications to chemical reaction networks [TB] ■ Our 
work also has parallels to the study of design ideals in algebraic statistics |17j . 

The organization of this paper is as follows. In Section [2] we introduce receptive field codes, and explore how 
the requirement of convexity enables these codes to constrain the structure of the underlying stimulus space. In 
Section [3] we define the neural ring and the neural ideal, and find explicit relations that enable us to compute 
these objects for any neural code. Section [4] is the heart of this paper. Here we present an alternative set of 
relations for the neural ring, and demonstrate how they enable us to "read off" receptive field structure from 
the neural ideal. We then introduce pseudo-monomials and pseudo-monomial ideals, by analogy to monomial 
ideals; this allows us to define a natural "canonical form" for the neural ideal. Using this, we can extract 
minimal relationships among receptive fields that are dictated by the structure of the neural code. Finally, we 
present an algorithm for finding the canonical form of a neural ideal, and illustrate how to use our formalism 
for inferring receptive field structure in a detailed example. Section [5] describes the primary decomposition of 
the neural ideal and, more generally, of pseudo-monomial ideals. Computing the primary decomposition of the 
neural ideal is a critical step in our canonical form algorithm, and it also yields a natural decomposition of the 
neural code in terms of intervals of the Boolean lattice. We end this section with an algorithm for finding the 
primary decomposition of any pseudo-monomial ideal, using ideas similar to those in the theory of square-free 
monomial ideals. All longer proofs can be found in Appendix 1. Appendix 2 contains a detailed classification 
of neural codes on three neurons. 

2 Background &; Motivation 

In this section we introduce the basic objects of study: neural codes, receptive field codes, and convex receptive 
field codes. We then discuss various ways in which the structure of a convex receptive field code can constrain 
the underlying stimulus space. These constraints emerge most obviously from the simplicial complex of a neural 
code, but (as will be made clear) there are also constraints that arise from aspects of a neural code's structure 
that go well beyond what is captured by the simplicial complex of the code. 

Given a set of neurons labelled {1, . . . , 71} = [n], we define a neural code C C {0, 1}™ as a set of binary patterns 
of neural activity. An element of a neural code is called a codeword, c — {c\, . . . , c„) € C, and corresponds to a 
subset of neurons 

supp(c) = {i e [n] I Ci — 1} c [n]. 
Similarly, the entire code C can be identified with a set of subsets of neurons, 

suppC d = {supp(c) \ceC}c 2^, 

where 2^ denotes the set of all subsets of [n]. Because we discard the details of the precise timing and/or 
rate of neural activity, what we mean by neural code is often referred to in the neural coding literature as a 
combinatorial code |18l 119] , 

A set of subsets A C 2^ is an (abstract) simplicial complex if a S A and r C o implies r S A. We will say 
that a neural code C is a simplicial complex if suppC is a simplicial complex. In cases where the code is not a 
simplicial complex, we can complete the code to a simplicial complex by simply adding in missing subsets of 
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codewords. This allows us to define the simplicial complex of the code as 

A(C) = f {a C [n] | a C supp(c) for some c e C}. 
Clearly, A(C) is the smallest simplicial complex that contains suppC. 

2.1 Receptive field codes (RF codes) 

Neurons in many brain areas have activity patterns that can be characterized by receptive fieldsj^j Abstractly, 
a receptive field is a map fa : A — > M>o from a space of stimuli, A, to the average firing rate of a single neuron, 
i, in response to each stimulus. Receptive fields are computed by correlating neural responses to independently 
measured external stimuli. We follow a common abuse of language, where both the map and its support (i.e., the 
subset Ui C X where fa takes on positive values) are referred to as "receptive fields." Convex receptive fields are 
convex subsets of the stimulus space, for X C Mr. The paradigmatic examples are orientation-selective neurons 
in visual cortex [3J 0] and hippocampal place cells [TJ |5] ■ Orientation-selective neurons have tuning curves that 
reflect a neuron's preference for a particular angle (see Figure 1A). Place cells are neurons that have place fields; 
i.e., each neuron has a preferred (convex) region of the animal's physical environment where it has a high firing 
rate (see Figure IB). Both tuning curves and place fields are examples of receptive fields. 
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Figure 1: Receptive field overlaps determine codewords in ID and 2D RF codes. (A) Neurons in a ID RF code have 
receptive fields that overlap on a line segment (or circle, in the case of orientation-tuning). Each stimulus on the line 
corresponds to a binary codeword. Gaussians depict graded firing rates for neural responses; this additional information 
is discarded by the RF code. (B) Neurons in a 2D RF code, such as a place field code, have receptive fields that partition 
a two-dimensional stimulus space into non-overlapping regions, as illustrated by the shaded area. All stimuli within one 
of these regions will activate the same set of neurons, and hence have the same corresponding codeword. 

A receptive field code (RF code) is a neural code that corresponds to the brain's representation of the 
stimulus space covered by the receptive fields. When a stimulus lies in the intersection of several receptive 
fields, the corresponding neurons may co-fire while the rest remain silent. The active subset a of neurons can 
be identified with a binary codeword c G {0, 1}™ via a — supp(c). Unless otherwise noted, a stimulus space X 
need only be a topological space. However, we usually have in mind X C M. d , and this becomes important when 
we consider convex RF codes. 

Definition. Let A be a stimulus space (e.g., X C M. d ), and let U = {U\, . . . , U n } be a collection of open sets, 
with each Ui C X the receptive field of the i-th neuron in a population of n neurons. The receptive field code 
(RF code) C(U) C {0, l} n is the set of all binary codewords corresponding to stimuli in X: 

C(U)^{ce{0,l} n \( p| Ui)\( |J 17,0^0}. 

itEsupp(c) j^supp(c) 

If X C IR d and each of the UiS is also a convex subset of A, then we say that C(U) is a convex RF code. 

1 In the vision literature, the term "receptive field" is reserved for subsets of the visual field; we use the term in a more general 
sense, applicable to any modality. 
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Our convention is that f] ie ^ Ui = X and Ui<=0 U = This means that if UT=i U X, then C(W) includes 
the all-zeros codeword corresponding to an "outside" point not covered by the receptive fields; on the other 
hand, if HiLi U ^ 0, then C(U) includes the all-ones codeword. Figure 1 shows examples of convex receptive 
fields covering one- and two-dimensional stimulus spaces, and examples of codewords corresponding to regions 
defined by the receptive fields. 

Returning to our discussion in the Introduction, we have the following question: If we can assume C = C(U) 
is a RF code, then what can be learned about the underlying stimulus space X from knowledge only of C, and 
not oflA ? The answer to this question will depend critically on whether or not we can assume that the RF code 
is convex. In particular, if we don't assume convexity of the receptive fields, then any code can be realized as a 
RF code in any dimension. 

Lemma 1. Let C C {0, 1}™ be a neural code. Then, for any d > 1, there exists a stimulus space X C W l and 
a collection of open sets li — {t/i, . . . , U n } (not necessarily convex), with Ui C X for each i G [n], such that 
C = C{U). 

Proof. Let C C {0, 1}™ be any neural code, and order the elements of C as {ci, . . . , c m }, where m = \C\. For 
each c G C, choose a distinct point x c G K d and an open neighborhood N c of x c such that no two neighborhoods 
intersect. Define Uj = f Ujesupp(c h ) N Ck , let U — {Ui, . . . , U n }, and X — \J r ^. 1 N Ci . Observe that if the all-zeros 
codeword is in C, then N = X \ 1J,™ =1 Ui corresponds to the "outside point" not covered by any of the UiS. By 
construction, C = C(U). □ 

Although any neural code C C {0, 1}" can be realized as a RF code, it is not true that any code can be 
realized as a convex RF code. Counterexamples can be found in codes having as few as three neurons. 

Lemma 2. The neural code C = {0, l} 3 \ {111, 001} on three neurons cannot be realized as a convex RF code. 

Proof. Assume the converse, and let U = {Ui, U2, U3} be a set of convex 
open sets in M d such that C = C(U). The code necessitates that Uif)U 2 7^ V~ 
(since 110 G C), {Uir\U 3 )\U 2 ^ (since 101 G C), and (C/ 2 nC/ 3 )\C/i ^ / » 
(since 011 G C). Let pi G (Ui H U 3 ) \ U 2 and p 2 G (U 2 n U 3 ) \ U x . Since I 
Pi, Pi G Us and U3 is convex, the line segment £ = (1 — t)p\ + tp 2 for \. 
t G [0, 1] must also be contained in C/ 3 . There are just two possibilities. 
Case 1: I passes through U Y n U 2 (see Figure 2, left). This implies Figure 2: Two cases in Lemma[2]proof. 
U\ fl U 2 n Us 7^ 0, and hence 111 G C, a contradiction. Case 2: £ does not intersect U\ n L^- Since t/i, ^2 are 
open sets, this implies i passes outside of U\ U U 2 (see Figure 2, right), and hence 001 G C, a contradiction. □ 

2.2 Stimulus space constraints arising from convex RF codes 

It is clear from Lemma [T] that there is essentially no constraint on the stimulus space for realizing a code as 
a RF code. However, if we demand that C is a convex RF code, then the overlap structure of the UiS sharply 
constrains the geometric and topological properties of the underlying stimulus space X. To see how this works, 
we first consider the simplicial complex of a neural code, A(C). Classical results in convex geometry and topology 
provide constraints on the underlying stimulus space X for convex RF codes, based on the structure of A(C). 
We will discuss these next. We then turn to the question of constraints that arise from combinatorial properties 
of a neural code C that are not captured by A(C). 

2.2.1 Helly's theorem and the Nerve theorem 

Here we briefly review two classical and well-known theorems in convex geometry and topology, Helly's theorem 
and the Nerve theorem, as they apply to convex RF codes. Both theorems can be used to relate the structure 
of the simplicial complex of a code, A(C), to topological features of the underlying stimulus space X. 

Suppose U — {Ui, . . . ,U n } is a finite collection of convex open subsets of M. d , with dimension d < n. We 
can associate to U a simplicial complex N(U) called the nerve oiU. A subset {i\, ..,ik} C [n] belongs to N(U) 
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if and only if the appropriate intersection C\e=i Ui e is nonempty. If we think of the {JjS as receptive fields, then 
N(U) = A(C(U)). In other words, the nerve of the cover corresponds to the simplicial complex of the associated 
(convex) RF code. 

Helly's theorem. Consider k convex subsets, U\, . . . , Uk C R d , for d < k. If the intersection of every d + 1 of 
these sets is nonempty, then the full intersection |"L=i * s a ^ so nonempty. 

A nice exposition of this theorem and its consequences can be found in |20j . One straightforward consequence 
is that the nerve N(U) is completely determined by its d-skeleton, and corresponds to the largest simplicial 
complex with that d-skcleton. For example, if d = 1, then N(U) is a clique complex (fully determined by its 
underlying graph). Since N(U) = A(C(U)), Holly's theorem imposes constraints on the minimal dimension of 
the stimulus space X when C — C(U) is assumed to be a convex RF code. 

Nerve theorem. The homotopy type of X(U) d = U% is equal to the homotopy type of the nerve of the 

cover, N(jU). In particular, X(JA) and N(U) have exactly the same homology groups. 

The Nerve theorem is an easy consequence of [2TJ Corollary 4G.3]. This is a powerful theorem relating the 
simplicial complex of a RF code, A(C{U)) = N(U), to topological features of the underlying space, such as 
homology groups and other homotopy invariants. Note, however, that the similarities between X{U) and N(U) 
only go so far. In particular, X(U) and N(U) typically have very different dimension. It is also important to 
keep in mind that the Nerve theorem concerns the topology of X(U) = U"=i Ui. I n our setup, if the stimulus 
space X is larger, so that U™=i ^ S= X, then the Nerve theorem tells us only about the homotopy type of X(U), 
not of X. Since the Ui are open sets, however, conclusions about the dimension of X can still be inferred. 

In addition to Helly's theorem and the Nerve theorem, there is a great deal known about A(C(U)) = N(U) for 
collections of convex sets in M. d . In particular, the /-vectors of such simplicial complexes have been completely 
characterized by G. Kalai in [2"2l |2"3"] . 

2.2.2 Beyond the simplicial complex of the neural code 

We have just seen how the simplicial complex of 
a neural code, A(C), yields constraints on the 
stimulus space X if we assume C can be realized 
as a convex RF code. The example described in 
Lemma [2j however, implies that other kinds of 
constraints on X may emerge from the combi- 
natorial structure of a neural code, even if there 
is no obstruction stemming from A(C). 

In Figure 3 we show four possible arrange- 
ments of three convex receptive fields in the 
plane. Each convex RF code has the same corre- 
sponding simplicial complex A(C) — 2^, since 
111 G C for each code. Nevertheless, the ar- 
rangements clearly have different combinatorial 
properties. In Figure 3C, for instance, we have 
U\ C U2 C C/3, while Figure 3 A has no spe- 
cial containment relationships among the recep- 
tive fields. This "receptive field structure" (RF 
structure) of the code has impliciations for the 
underlying stimulus space. 

Let d be the minimal integer for which the 
code can be realized as a convex RF code in M. d ; 
we will refer to this as the minimal embedding 
dimension of C. Note that the codes in Figure 3A,D have d — 2, whereas the codes in Figure 3B,C have d = 1. 
The simplicial complex, A(C), is thus not sufficient to determine the minimal embedding dimension of a convex 
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Figure 3: Four arrangements of three convex receptive fields, 
U = {C/i,^,^}, each having A(C(W)) = 2 [31 . Square boxes 
denote the stimulus space X in cases where Ui U U2 U U3 C 
X. (A) C(U) = 2 [3] , including the all-zeros codeword 000. 
(B) C{U) = {111,101,011,001}, with X = U 3 . (C) C(U) = 
{111,011,001,000}. (D) C{U) = {111,101,011,110,100,010}, and 
X — Ui U Ui. The minimal embedding dimension for the codes in 
panels A and D is d — 2, while for panels B and C it is d = 1. 
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RF code, but this information is somehow present in the RF structure of the code. Similarly, in Lemma [2] we 
saw that A(C) does not provide sufficient information to determine whether or not C can be realized as a convex 
RF code; after working out the RF structure, however, it was easy to see that the given code was not realizable. 

2.2.3 The receptive field structure (RF structure) of a neural code 

As we have just seen, the intrinsic structure of a neural code contains information about the underlying stimulus 
space that cannot be inferred from the simplicial complex of the code alone. This information is, however, present 
in what we have loosely referred to as the "RF structure" of the code. We now explain more carefully what we 
mean by this term. 

Given a set of receptive fields IA = {[/i ,...,£/„} in a stimulus space X, there are certain containment relations 
between intersections and unions of the L^s that are "obvious," and carry no information about the particular 
arrangement in question. For example, U\ PI U-x C U2 U Us U U4 is always guaranteed to be true, because it 
follows from {/ 2 C U2 . On the other hand, a relationship such as Us C U\ U U2 (as in Figure 3D) is not always 
present, and thus reflects something about the structure of a particular receptive field arrangement. 

Let C C {0, 1}™ be a neural code, and let U = {Ui, . . . , U n } be any arrangement of receptive fields in a 
stimulus space X such that C = C(bt) (this is guaranteed to exist by LemmaJT]). The RF structure of C refers to 
the set of relations among the Us that are not "obvious," and have the form: 

H Ui C (J Uj, for a (It = 0. 

In particular, this includes any empty intersections f] iea Ui = (here t = 0). In the Figure 3 examples, the 
panel A code has no RF structure relations; while panel B has U\ C Us and U% C Us] panel C has U\ C U2 C Us] 
and panel D has U3 C U\ U U2. 

The central goal of this paper is to develop a method to algorithmically extract a minimal description of the 
RF structure directly from a neural code C, without first realizing it as CilA) for some arrangement of receptive 
fields. We view this as a first step towards inferring stimulus space features that cannot be obtained from the 
simplicial complex A(C). To do this we turn to an algebro-geometric framework, that of neural rings and ideals. 
These objects are defined in Section [3] so as to capture the full combinatorial data of a neural code, but in a 
way that allows us to naturally and algorithmically infer a compact description of the desired RF structure, as 
shown in Section |U 



3 Neural rings and ideals 

In this section we define the neural ring Rq and a closely-related neural ideal, Jq. First, we briefly review some 
basic algebraic geometry background needed for our definitions. 

Let k be a field, n the number of neurons, and k[xi, . . . , x n ] a polynomial ring with one indeterminate Xi for 
each neuron. We will consider k n to be the neural activity space, where each point v — (u l5 . . . ,v n ) € k n is a 
vector tracking the state Vi of each neuron. Note that any polynomial / G k[xi, . . . , x n ] can be evaluated at a 
point v € k n by setting Xi — i?j each time Xi appears in /. We will denote this value f(v). 

Let J C k[xi, . . . , x n ] be an ideal, and define the variety 

V(J) d = {v e k n I f(v) = for all / e J}. 

Similarly, given a subset S C k n , we can define the ideal of functions that vanish on this subset as 

I{S) d = {/ G k[x u ....,x n ] I f(v) = for all v G S}. 

The ideal- variety correspondence [21] gives us the usual order-reversing relationships: / C J => V(J) C V(I), 
and S C T => I{T) C I(S). Furthermore, V(I(V)) = V for any variety V, but it is not always true that 



I(V(J)) = J for an ideal J (see Section 6.1). We will regard neurons as having only two states, "on" or "off," 
and thus choose k = F 2 = {0, 1}. 
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3.1 Definition of the neural ring 



Let C C {0, 1}" = Fj be a neural code, and define the ideal Ic of Fgjaii, . . . ,x n ] corresponding to the set of 
polynomials that vanish on all codewords in C: 

I c = f 1(C) = {/ G F 2 [x u ...,x n ] | /(c) = for all c G C}. 
By design, V(Ic) = C and hence I(V(Ic)) = Ic- Note that the ideal generated by the Boolean relations, 

n A — l 2 _ 2 _ \ 

is automatically contained in Ic, irrespective of C. 

The neural ring Rc corresponding to the code C is the quotient ring 

Re d = V 2 [xi, . . .,x n ]/I c , 

together with the set of indeterminates X\, . . . ,x n . We say that two neural rings are equivalent if there is a 
bijection between the sets of indeterminates that yields a ring homomorphism. 

Remark. Due to the Boolean relations, any element y € Rc satisfies y 2 = y (cross-terms vanish because 2 = 

ic I 

in F2), so the neural ring is a Boolean ring isomorphic to F 2 ■ It is important to keep in mind, however, that Rc 
comes equipped with a privileged set of functions, X\, . . . ,x n ; this allows the ring to keep track of considerably 
more structure than just the size of the neural code. 



3.2 The spectrum of the neural ring 

We can think of Rc as the ring of functions of the form / : C — > F 2 on the neural code, where each function 
assigns a or 1 to each codeword c G C by evaluating / G Fa^i, . .. ,x n ]/Ic through the substitutions Xi = Ci 
for i = 1, . . . ,n. Quotienting the original polynomial ring by Ic ensures that there is only one zero function 
in Rc- The spectrum of the neural ring, Spec(i?e), consists of all prime ideals in Rc- We will see shortly that 
the elements of Spec(i?c) are m one-to-one correspondence with the elements of the neural code C. Indeed, our 
definition of Rc was designed for this to be true. 

For any point v G {0, 1}™ of the neural activity space, let 

m v d = I(v) = {f G F 2 [xi, ...,x n ] I f(v) = 0} 
be the maximal ideal of F2[xi, . . . ,x n ] consisting of all functions that vanish on v. We can also write m v — 



(x\ — V\, . . . , x n — v n ) (see Lemma 16 in Section 6.1 ). Using this, we can characterize the spectrum of the neural 
ring. 

Lemma 3. Spec(i?e) = {rhv \ v G C}, where rh v is the quotient of m v in Rc- 



The proof is given in Section |6.1| Note that because Rc is a Boolean ring, the maximal ideal spectrum and the 
prime ideal spectrum coincide. 



3.3 The neural ideal &: an explicit set of relations for the neural ring 

The definition of the neural ring is rather impractical, as it does not give us explicit relations for generating 
Ic and Rc. Here we define another ideal, Jc, via an explicit set of generating relations. Although Jc is closely 
related to Ic , it turns out that Jc is a more convenient object to study, which is why we will use the term neural 
ideal to refer to Jc rather than Ic ■ 

For any v G {0, 1}", consider the function p v G F 2 [xi, . . . , x n ] defined as 

n 

p v = - Vi - = Yl x i II 0-- x j)= IT x% n 

i=l {i\Vi=l} {j I Vj=0} iGsupp(-u) jfsupp(v) 
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Note that p v (x) can be thought of as a characteristic function for v, since it satisfies p v (v) = 1 and p v (x) = 
for any other x G W%. Now consider the ideal Jc C F 2 [xi, . . . , x n ] generated by all functions p v , for v £ C: 

Jc = ({Pv\v£C}). 

We call Jc the neural ideal corresponding to the neural code C. If C = 2M is the complete code, we simply set 
Jc = 0, the zero ideal. Jc is related to Ic as follows, giving us explicit relations for the neural ring. 

Lemma 4. Let C C {0, 1}™ be a neural code. Then, 

I c = Jc+B = ({ Pv \viC], { Xi {\ - a) | i G [n]}>, 

where B = ({xj(l — Xj) | i G ["■]}) is £/ie idea? generated by the Boolean relations, and Jc is the neural ideal. 

The proof is given in Section |6.1| 



4 How to infer RF structure using the neural ideal 

This section is the heart of the paper. We begin by presenting an alternative set of relations that can be used to 
define the neural ring. These relations enable us to easily interpret elements of Ic as receptive field relationships, 
clarifying the connection between the neural ring and ideal and the RF structure of the code. We next introduce 
pseudo-monomials and pseudo-monomial ideals, and use these notions to obtain a minimal description of the 
neural ideal, which we call the "canonical form." Theorem [2] enables us to use the canonical form of Jc in order 
to "read off" a minimal description of the RF structure of the code. Finally, we present an algorithm that 
inputs a neural code C and outputs the canonical form CF(Jc), and illustrate its use in a detailed example. 



4.1 An alternative set of relations for the neural ring 

Let C C {0, 1}™ be a neural code, and recall by Lemma[l]that C can always be realized as a RF code C = C(bt), 
provided we don't require the UiS to be convex. Let X be a stimulus space and U = {Ui}f =1 a collection of 
open sets in X, and consider the RF code CilA). The neural ring corresponding to this code is Rctu)- 
Observe that the functions / G Rctu) can be evaluated at any point peXby assigning 



Xi{p) 



I ifpet/i 
\ipiUi 



each time xi appears in the polynomial /. The vector (xi(p), . . . , x n {p)) G {0, 1}™ represents the neural response 
to the stimulus p. Note that if p £ U"=i ^> then (xi(p), . . . , x n {p)) = (0, . . . , 0) is the all-zeros codeword. For 
any a C [n], define 

U a = f P| U t , and x a = f x { . 

i £ u i^a 

Our convention is that xq = 1 and Uq — X, even in cases where X D UILi Note that for any 



Xa{p) 



1 if pEU a 
if P tU a 



The relations in Ic{U) encode the combinatorial data of U. For example, if U a = then we cannot have 
x (j —~ 1 at any point of the stimulus space X, and must therefore impose the relation x a to "knock off" those 
points. On the other hand, if U a C {/, U Uj, then x a = 1 implies either Xi = 1 or Xj — 1, something that 
is guaranteed by imposing the relation x a (l — Xj){\ — Xj). These observations lead us to an alternative ideal, 
lu C Fa [a;i, ... , X n ], defined directly from the the arrangment of receptive fields U = {U\, . . . , U n }: 



Iu = ({x*H(l-Xi) | U a C \JUi}). 



def 

\\x„ 
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Note that if r = 0, we only get a relation for U a = 0, and this is x a . If a = 0, then U a = X, and we only get 
relations of this type if X is contained in the union of the L^s. This is equivalent to the requirement that there 
is no "outside point" corresponding to the all-zeros codeword. 

Perhaps unsurprisingly, it turns out that Iu and Ic{u) exactly coincide, so Iu provides an alternative set of 
relations that can be used to define Rc(u)- 

Theorem 1. I u = I c{u) . 

The proof is given in Section [672] 



4.2 Interpreting neural ring relations as receptive field relationships 

Theorem [T] suggests that we can interpret elements of Ic in terms of relationships between receptive fields. 

Lemma 5. Let C C {0,1}™ be a neural code, and let U — {U\, . . . , U n } be any collection of open sets (not 
necessarily convex) in a stimulus space X such that C = C(U). Then, for any pair of subsets a, t C [n], 

Xa -Xi)eI C & C |J Ut. 

Proof. (-4=) This is a direct consequence of Theorem[l] (=>) We distinguish two cases, based on whether or not a 
and r intersect. If x a Wi^^ — Xi) € Ic and crHr ^ 0, then x a Yl i£T {]-—Xi) € B, where B — ({^(1— xi) \i£ [n]}) 
is the ideal generated by the Boolean relations. Consequently, the relation does not give us any information 
about the code, and U a C ljj 6r {/, follows trivially from the observation that LZj C U i for any i £ a n r. If, on 
the other hand, x a Y\ ieT {^- — Xi) £ Iq and ctOt — 0, then p v £ Ic for each v £ {0, 1}™ such that supp(u) 2 & and 
supp(w) n t = 0. Since p v (v) = 1, it follows that v ^ C for any v with supp(u) 2 o~ and supp(w) fl r = 0. To see 
this, recall from the original definition of Ic that for all c £ C, /(c) = for any / £ Ic; it follows that p t) (c) = 
for all c £ C. Because C — C(U), the fact that v ^ C for any t? such that supp(u) 2 cr and supp(t>) fir = implies 
Hiea ^ \ Ujgt = 0- We can thus conclude that U a C (j j . er {7,-. □ 

Lemma [5] allows us to extract RF structure from the different types of relations that appear in 7 ( 



c- 



• Boolean relations: {^^(1 — x^}. The relation Xi(l — x{) corresponds to Ui C Ui, which does not contain 
any information about the code C. 

• Type 1 relations: {av}. The relation x a corresponds to U a = 0. 

• Type 2 relations: {x a ]\ teT {l - x t ) \ a, r ^ 0, a n r = 0, J7 CT ^ and U er ^ ^ X }- 
The relation a; CT n jgT (l — »i) corresponds to U a C U i£r f/j. 

• Type 3 relations: { Ilier(l — x i)} ■ The relation n<e-7-(l ~ x i) corresponds to X C lJie T 

The somewhat complicated requirements on the Type 2 relations ensure that they do not include polynomials 
that are multiples of Type 1, Type 3, or Boolean relations. Note that the constant polynomial 1 may appear as 
both a Type 1 and a Type 3 relation, but only if X = 0. The four types of relations listed above are otherwise 
disjoint. Type 3 relations only appear if X is fully covered by the receptive fields, and there is thus no all-zeros 
codeword corresponding to an "outside" point. 

Not all elements of Ic are one of the above types, of course, but we will see that these are sufficient to 



generate Ic- This follows from the observation (sec Lemma 19) that the neural ideal Jc is generated by the 
Type 1, Type 2 and Type 3 relations, and recalling that Ic is obtained from Jc be adding in the Boolean 
relations (Lemma Eh. At the same time, not all of these relations are necessary to generate the neural ideal. 
Can we eliminate redundant relations to come up with a "minimal" list of generators for Jc , and hence Ic , that 
captures the essential RF structure of the code? This is the goal of the next section. 
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4.3 Pseudo-monomials & a canonical form for the neural ideal 



The Type 1, Type 2, and Type 3 relations are all products of linear terms of the form Xi and 1 — Xi, and are 
thus very similar to monomials. By analogy with square-free monomials and square-free monomial ideals j!2) . 
we define the notions of pseudo-monomials and pseudo-monomial ideals. Note that we do not allow repeated 
indices in our definition of pseudo-monomial, so the Boolean relations are explicitly excluded. 

Definition. If / £ F 2 [xi, . . . , x n ] has the form / = Yl i&(7 Xi Ylj eT (l — Xj) for some <t,t C [n] with a n r = 0, 
then we say that / is a pseudo-monomial. 

Definition. An ideal J C F 2 [xi, . . . , x n ] is a pseudo-monomial ideal if J can be generated by a finite set of 
pseudo- monomials. 

Definition. Let J C F 2 [a:i, . . . ,x n ] be an ideal, and / € J a pseudo-monomial. We say that / is a minimal 
pseudo-monomial of J if there does not exist another pseudo-monomial g G J with deg(g) < deg(/) such that 
/ = hg for some h £ F 2 [x\ , . . . , x n ] . 

By considering the set of all minimal pseudo-monomials in a pseudo-monomial ideal J, we obtain a unique and 
compact description of J, which we call the "canonical form" of J. 

Definition. We say that a pseudo-monomial ideal J is in canonical form if we present it as J = (fx, ...,//), 
where the set CF(J) = f {/1, ...,//} is the set of all minimal pseudo-monomials of J. Equivalently, we refer to 
CF(J) as the canonical form of J. 

Clearly, for any pseudo-monomial ideal J C ¥2[xi, . . . ,x n ], CF(J) is unique and J = (CF(J)). On the 
other hand, it is important to keep in mind that although CF(J) consists of minimal pseudo- monomials, it 
is not necessarily a minimal set of generators for J. To see why, consider the pseudo-monomial ideal J = 
(xi(l — X2), £2(1 — x 3)}- This ideal in fact contains a third minimal pseudo-monomial: x±(l — X3) = (1 — £3) • 
[xi(l — x 2 )] + x\ ■ [x 2 (l — x 3 )]. It follows that CF(J) = {xx{\ — x 2 ), x 2 (l — £3), xi(l — x 3 )}, but clearly we can 
remove x\(l — X3) from this set and still generate J. 

For any code C, the neural ideal Jq is a pseudo-monomial ideal because Jq = ({p v \ v (fc C}), and each of the 
p v s is a pseudo-monomial. (In contrast, Iq is rarely a pseudo-monomial ideal, because it is typically necessary 
to include the Boolean relations as generators.) Theorem [2] describes the canonical form of Jc- In what follows, 
we say that a C [n] is minimal with respect to property P if a satisfies P, but P is not satisfied for any r C a. 
For example, if XJ a = and for all r C a we have U T 7^ 0, then we say that "<r is minimal w.r.t. U a = 0." 

Theorem 2. Let C C {0, 1}" be a neural code, and let IA = {U%, . . . ,U n } be any collection of open sets (not 
necessarily convex) in a nonempty stimulus space X such that C = C(U). The canonical form of Jc is: 

Jc = I cr is minimal w.r.t. U a = 0}, 

{x a — Xi) I a, t 0, <j H t = 0, U a 7^ 0, Ui 7^ X, and a, r are each minimal w.r.t. U a C t/j}, 



{ ~ Xi) I r is minimal w.r.t. X C Ui}). 



We call the above three (disjoint) sets of relations comprising CF(Jc) the minimal Type 1 relations, the minimal 
Type 2 relations, and the minimal Type 3 relations, respectively. 



The proof is given in Section 6.3 Note that, because of the uniqueness of the canonical form, if we are given 
CF(Jc) then Theorem [2] allows us to read off the corresponding (minimal) relationships that must be satisfied 
by any receptive field representation of the code as C = C(U): 

• Type 1: x„ € CF( Jc) implies that U a = 0, but all lower-order intersections U 1 with 7 C a are non-empty. 

• Type 2: x a Y\i eT {^ — %i) € CF(Jc) implies that U a C lj ier Ui, but no lower-order intersection is contained 
m Uigr Ui, and all the t/jS are necessary for U a C lj ier Ui. 
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• Type 3: IlieT^ ~ x i) e CF(Jc) implies that X C lJ igT U, but X is not contained in any lower-order 
union |J ie7 U l for 7 C r. 

The canonical form CF(Jc) thus provides a minimal description of the RF structure dictated by the code C. 
The Type 1 relations in CF{Jq) can be used to obtain a (crude) lower bound on the minimal embedding 



dimension of the neural code, as defined in Section 2.2.2 Recall Helly's theorem (Section 2.2.1), and observe 



that if x a € CF(Jc) then a is minimal with respect to U a — 0; this in turn implies that \a\ < d + 1. (If 
\<r\ > d + 1, by minimality all d + 1 subsets intersect and by Helly's theorem we must have U a ^ 0.) We can 
thus obtain a lower bound on the minimal embedding dimension d as 

d > max lal — 1, 

{a\x a dCF (J C )} 

where the maximum is taken over all a such that x CT is a Type 1 relation in CF(Jq)- This bound only depends 
on A(C), however, and does not provide any insight regarding the different minimal embedding dimensions 
observed in the examples of Figure 3. These codes have no Type 1 relations in their canonical forms, but they 
are nicely differentiated by their minimal Type 2 and Type 3 relations. From the receptive field arrangements 
depicted in Figure 3, we can easily write down CF(Jc) for each of these codes. 

A. CF(Jc) = {0}. There are no relations here because C = 2^\. 

B. CF ( J c ) = {1 - £3}. This Type 3 relation reflects the fact that X = U 3 . 

C. CF( Jc) = {x\{l — £2), £2(1 — £3), — 23)}. These Type 2 relations correspond to U\ C U2, Ui C U3, 
and U\ C Us- Note that the first two of these receptive field relationships imply the third; correspondingly, 
the third canonical form relation satisfies: Xi(l — X3) = (1 — X3) • [xi(l — £2)] + X\ ■ [x2(l — X3)]. 

D. CF( J C ) = {(1 - xi)(l - x^}. This Type 3 relation reflects X = Ui U U 2 , and implies U 3 C Ux U U 2 - 

Nevertheless, we do not yet know how to infer the minimal embedding dimension from CF(Jc). In Appendix 2 
(SectionJT]), we provide a complete list of neural codes on three neurons, up to permutation, and their respective 
canonical forms. 



4.4 Comparison to the Stanley-Reisner ideal 

Readers familiar with the Stanley-Reisner ideal [321 [13] will recognize that this kind of ideal is generated by 
the Type 1 relations of a neural code C. The corresponding simplicial complex is A(C), the smallest simplicial 
complex that contains the code. 

Lemma 6. Let C = C(IA). The ideal generated by the Type 1 relations, (x CT | U a = 0), is the Stanley-Reisner 
ideal of A(C). Moreover, i/suppC is a simplicial complex, then CF(Jc) contains no Type 2 or Type 3 relations, 
and Jq is thus the Stanley-Reisner ideal for suppC. 

Proof. To see the first statement, observe that the Stanley-Reisner ideal of a simplicial complex A is the ideal 

Ia = <x CT I a i A), 

and recall that A(C) — {a C [n] | a C supp(c) for some c G C}. As C = C{U), an equivalent characterization is 
A(C) — {a C [n] I C/^ =/= 0}. Since these sets are equal, so are their complements in 2^: 

{a C [ n ] I CT g A(C)} = {a C [n] | [7 CT = 0}. 

Thus, (x CT I f/o- = 0) = (x CT I cr ^ A(C)), which is the Stanley-Reisner ideal for A(C). 

To prove the second statement, suppose that suppC is a simplicial complex. Note that C must contain the 
all-zeros codeword, so X D U»=i ^» an( i there can be no Type 3 relations. Suppose the canonical form of Jc 
contains a Type 2 relation x CT J| i(Er (l — Xf), for some a, t C [n] satisfying cr, t ^ 0, a n r = and U„ ^ §. 
The existence of this relation indicates that cr ^ suppC, while there does exist anw£C such that cr C w. This 
contradicts the assumption that suppC is a simplicial complex. We conclude that Jc has no Type 2 relations. □ 
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The canonical form of Jc thus enables us to immediately read off, via the Type 1 relations, the minimal 
forbidden faces of the simplicial complex A(C) associated to the code, and also the minimal deviations of C from 
being a simplicial complex, which are captured by the Type 2 and Type 3 relations. 



4.5 An algorithm for obtaining the canonical form 

Now that we have established that a minimal description of the RF structure can be extracted from the canonical 
form of the neural ideal, the most pressing question is the following: 

Question: How do we find the canonical form CF(Jc) if all we know is the code C, and we are not given a 
representation of the code as C = C{U)1 

In this section we describe an algorithmic method for finding CF(Jc) from knowledge only of C. It turns out 
that computing the primary decomposition of Jc is a key step towards finding the minimal pseudo-monomials. 
This parallels the situation for monomial ideals, although there are some additional subtleties in the case of 
pseudo-monomial ideals. As previously discussed, from the canonical form we can read off the RF structure of 
the code, so the overall workflow is as follows: 



TT _ . „ neural code neural ideal . . . ,. r> _ 

Workflow: „ ,„ „,„ — > _ , , . , „, . — > decomposition — > form — > bib structure 
C C {0, 1}" J c = ({p v \viC}) 



primary canonical minimal 

>mposition — > form — > RF struct 
of J c CF(J C ) ofC 



Canonical form algorithm 
Input: A neural code C C {0, 1}". 

Output: The canonical form of the neural ideal, CF(Jc). 
Step 1: From C C {0, 1}", compute J c = ({p v \ v £ C}). 

Step 2: Compute the primary decomposition of Jc- It turns out (see Theorem [3] in the next section) that this 
decomposition yields a unique representation of the ideal as 

Jc = f] Pa, 

aeA 

where each a £ A is an element of {0, 1, *}", and p a is defined as 

Pa = f ({Xi - Oi | Oi 7^ *}) = ({Xi | a, = 0}, {1 - Xj I Oj = 1}). 

Note that the p a s are all prime ideals. We will see later how to compute this primary decomposition 
algorithmically, in Section [5. 3| 



Step 3: Observe that any pseudo-monomial f E Jc must satisfy / £ p a for each a € A. It follows that / is a 
multiple of one of the linear generators of p a for each a £ A. Compute the following set of elements of Jc- 



M(Jc) = { JJ 9a | 9a = xi - a t for some a, ^ *}. 



aeA 

Ai(Jc) consists of all polynomials obtained as a product of linear generators g a , one for each prime ideal 
p Q of the primary decomposition of Jc ■ 

Step 4: Reduce the elements of Ai(Jc) by imposing a^(l — a;,-) = 0. This eliminates elements that are not 
pseudo-monomials. It also reduces the degrees of some of the remaining elements, as it implies xf = Xi 
and (1 — x^ 2 = (1 — Xi). We are left with a set of pseudo-monomials of the form / = Yliecr Xi YijerO- — x j) 
for r n a = 0. Call this new reduced set M(Jc)- 

Step 5: Finally, remove all elements of A4( Jc) that are multiples of lower-degree elements in A4(Jc)- 

Proposition 1. The resulting set is the canonical form CF(Jc). 

The proof is given in Section |6.4| 
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4.6 An example 



Now we are ready to use the canonical form algorithm in an example, illustrating how to obtain a possible 
arrangement of convex receptive fields from a neural code. 

Suppose a neural code C has the following 13 codewords, and 19 missing words: 



{00000, 10000, 01000, 00100, 00001, 
11000, 10001, 01100, 00110, 00101, & {0, 1} 5 \C 
00011, 11100, 00111}, 



{00010, 
11010, 
OHIO, 
11011, 



10100, 
11001, 
01101, 
10111, 



10010, 
10110, 
01011, 
01111, 



01010, 
10101, 
11110, 

11111}. 



01001, 
10011, 
11101, 



Thus, the neural ideal Jc has 19 generators, using the original definition Jq — ({p v \ v £ C}}: 



- x 3 )(l - x 5 ), 



„^ j „^ \ l.r v | T~ 

1 - CCl)(l - 2 2 )(1 - X 3 )(l - Xs), XlX 3 (l - 2 2 )(1 - 2 4 )(1 - Xb),X\Xa{1 - £ 2 )(1 - x 3 ] 

■2X4(1 — xi)(l — x 3 )(l — x 5 ),x 2 x 5 (l — xi)(l — x 3 )(l — £4), 2i2 2 2 4 (l — 2 3 )(1 — Xb), 
[1 - x 3 )(l - 2 4 ),2i2 3 2 4 (l - 2 2 )(1 - 25), 2:12:32:5(1 - 2 2 )(1 - 24), 2-12-42:5(1 - x 2 )(l 

fX4,(l — Xl)(l — 2 5 ), 222325(1 — 2i)(l — 2 4 ), 2-22-42-5(1 — 2l)(l — 23), 21222324(1 — 2 5 ) 
21222325(1 — X4), 21222425(1 — 23), 21232425(1 — 22), 22232425(1 — 2l), 2122232425). 



Jc = (24(1 - 2i)(l - 
2224 
2i2 2 2 5 (l - 
222324 



Despite the fact that we are considering only five neurons, this looks like a complicated ideal. Considering the 
canonical form of Jq will help us to extract the relevant combinatorial information and allow us to create a 
possible arrangement of receptive fields U that realizes this code as C = C(U). Following Step 2 of our canonical 
form algorithm, we take the primary decomposition of Jq: 

j c = (xi,x 2 ,x 4 ) n (xi,x 2 , 1 - £3) n (xi,x2, 1 - x 5 ) n (x 2 ,x 3 , X4) n (x 3 ,x 4 ,x 5 ) n (xi,x 4 ,x 5 ) n (l - x 2 ,x 4 ,x 5 ). 

Then, as described in Steps 3-5 of the algorithm, we take all possible products amongst these seven larger ideals, 
reducing by the relation Xj(l — Xj) = (note that this gives us Xj = xf and hence we can say x\ = x» for any 
k > 1). We also remove any polynomials that are multiples of smaller-degree pseudo- monomials in our list. 
This process leaves us with six minimal pseudo-monomials, yielding the canonical form: 

Jc = (CF(Jc)) = (X1X3X5, x 2 x 5 , X1X4, x 2 x 4 , xix 3 (l - x 2 ), x 4 (l - x 3 )(l - x 5 )). 

Note in particular that every generator we originally put in Jc is a multiple of one of the six relations in CF(Jc). 
Next, we consider what the relations in CF(Jc) tell us about the arrangement of receptive fields that would be 
needed to realize the code as C = C{U). 

1. xix 3 x 5 e CF{ J C ) => Ui H U 3 n U 5 = 0, while Ui n U 3 , U 3 n U 5 and Ui n U 5 are all nonempty. 

2. x 2 X5 e CF(Jc) => U2 H U5 — 0, while C/ 2 , U5 are both nonempty. 

3. X1X4 € CF(Jc) =>■ Ui ("I Ui = 0, while Ui, are both nonempty. 

4. x 2 X4 G CF(Jc) =>■ U2 ("I U4, = 0, while U 2 , U4 are both nonempty. 

5. xix 3 (l - x 2 ) G CF(J C ) => Ui n U 3 C [/ 2 , while ^ 2 ^2, t/3 % U 2 , and f7i n U 3 + 0. 

6. x 4 (l - x 3 )(l - x 5 ) G CF(J C ) ^U 4 CU 3 U U 5 , while [/ 4 ^ 0, and that [/ 4 % U 3 , U 4 % U 6 . 

The minimal Type 1 relations (1-4) tell us that we should draw Ui, U 3 and U5 with all pairwise intersections, 
but leaving a "hole" in the middle since the triple intersection is empty. Then U 2 should be drawn to intersect 
U\ and U 3 , but not U5. Similarly, U4 should intersect U 3 and U5, but not U\ or U 2 - The minimal Type 2 
relations (5-6) tell us that U 2 should be drawn to contain the intersection U\ n U 3 , while U4 lies in the union 
U 3 U U 5 , but is not contained in U 3 or U 5 alone. There are no minimal Type 3 relations, as expected for a code 
that includes the all-zeros codeword. 

Putting all this together, and assuming convex receptive fields, we can completely infer the receptive field 
structure, and draw the corresponding picture (see Figure 4). It is easy to verify that the code C(U) of the 
pictured arrangement indeed coincides with C. 
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Figure 4: An arrangement of five sets that realizes C as C(U). 



5 Primary decomposition 

Let C C {0, 1}™ be a neural code. The primary decomposition of Ic is boring 



c£C 



where m v for any v € {0, 1}™ is the maximal ideal I(v) defined in Section 3.2 This simply expresses Ic as the 
intersection of all maximal ideals m c for c G C, because the variety C = V(Ic) is just a finite set of points and 
the primary decomposition reflects no additional structure of the code. 

On the other hand, the primary decomposition of the neural ideal Jq retains the full combinatorial structure 
of C. Indeed, we have seen that computing this decomposition is a critical step towards obtaining CF{Jq), which 
captures the receptive field structure of the neural code. In this section, we describe the primary decomposition 
of Jc and discuss its relationship to some natural decompositions of the neural code. We end with an algorithm 
for obtaining primary decomposition of any pseudo-monomial ideal. 

5.1 Primary decomposition of the neural ideal 

We begin by defining some objects related to F2[xi, . . . ,x n ] and {0, 1}™, without reference to any particular 
neural code. For any a € {0, 1, *}", we define the variety 

V a = {v e {0, 1}" | m = at for all i s.t. a, # *} C {0, 1}". 

This is simply the subset of points compatible with the word "a" , where * is viewed as a "wild card" symbol. 
Note that V v = {v} for any v £ {0, 1}™. We can also associate a prime ideal to a, 

Pa = f {{xi - a t \ai^ *}) C F 2 [£Ci, . . . ,x n ], 
consisting of polynomials in F2[xi, . . . ,x n ] that vanish on all points compatible with a. To obtain all such 



polynomials, we must add in the Boolean relations (see Section 6.1 ) 



q a = I(V a ) = Pa + {x\ -Xl,...,X*- X n ). 

Note that V a = V(p„) = V(q a ). 

Next, let's relate this all to a code C C {0, l} ra . Recall the definition of the neural ideal, 

n 

Jc = ({Pv \v£C}) = ({Y[(( Xl - Vi )-l)\vt C}). 

i=l 

We have the following correspondences. 
Lemma 7. J c C p a <4> V a C C. 
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Proof. (=>) J c C p a =4> V(p ) C V(J C ). Recalling that V(p ) = V a and V{J C ) = C, this gives K C C. 

(-4=) V a C C =>■ /(C) C I(V a ) => Ic Q q a - Recalling that both Iq and q a differ from Jc and p a , respectively, by 

the addition of the Boolean relations, we obtain Jc C p a . □ 

Lemma 8. For any a, b 6 {0, 1, *}", K C Vj o pj C p a . 

Proof. (=>) Suppose V a C V . Then, for any i such that 6^ ^ * we have a, = 6j. It follows that each generator 
of p b is also in p a , so p b C p a . (<<=) Suppose p b C p a . Then, V a = V(p a ) C V(p&) = V b . □ 

Recall that a an ideal p is said to be a minimal prime over J if p is a prime ideal that contains J, and there 
is no other prime ideal p' such that p D p' D J. Minimal primes p a 3 J c correspond to maximal varieties V a 
such that Vq C C. Consider the set 

Ac = {o6{0,l,*} n |V,CC}. 

We say that a € 4c is maximal if there does not exist another element 6 G ,4c such that V a C VJ, (i.e., a € 4c 
is maximal if V a is maximal such that V a CC). 

Lemma 9. TTie element a G Ac is maximal if and only ifp a is a minimal prime over Jc- 

Proof. Recall that a € Ac V a C C, and hence Jc C p a (by Lemma [7]). (=») Let a G 4c be maximal, and 
choose b € {0, 1, *} such that Jc C p b C p a . By Lemmas [7] and [8j V a C T4 C C. Since a is maximal, we conclude 
that b = a, and hence p b = p a . It follows that p a is a minimal prime over Jc- (<=) Suppose p a is a minimal 
prime over Jc- Then by Lemma [7J a G Ac- Let b be a maximal element of Ac such that V a C Vb Q C. Then 
Jc C pi C p a . Since p a is a minimal prime over Jc, Pb = Pa and hence b — a. Thus a is maximal in Ac- □ 

We can now describe the primary decomposition of Jc- Here we assume the neural code C C {0, 1}™ is non-empty, 
so that Jc is a proper pseudo-monomial ideal. 

Theorem 3. Jc = [\ = i Pa { is the unique irredundant primary decomposition of Jc, where p ai , . . . ,p ae are the 
minimal primes over Jc ■ 

The proof is given in Section |6.6| Combining this theorem with Lemma [9j we have: 

Corollary 1. Jc = [~)i=i Pai * s ^ e unique irredundant primary decomposition of Jc, where oi, . . . , ag are the 
maximal elements of Ac ■ 



5.2 Decomposing the neural code via intervals of the Boolean lattice 

From the definition of Ac , it is easy to see that the maximal elements yield a kind of "primary" decomposition 
of the neural code C as a union of maximal V s. 

Lemma 10. C = (Ji=i V ai> where a\, . ..,at are the maximal elements of Ac- (I.e., p ai , . . . ,p ae are the minimal 
primes in the primary decomposition of Jc ■) 

Proof. Since V a C C for any a G Ac, clearly U i=1 V ai C C. To see the reverse inclusion, note that for any c G C, 
c G V c C V a for some maximal a G Ac- Hence, C C |Ji=i ^a>- ^ 

could also be regarded as a corollary of TheoremjiJ since C = V(Jc) = V(fY i=1 p a< ) = 



Note that Lemma 
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U i=1 ^(Poi) = Ui=i an d the maximal a G 4c correspond to minimal primes p a ^ Jc- Although we were 
able to prove Lemma 10 directly, in practice we use the primary decomposition in order to find (algorithmically) 
the maximal elements oi, . . . , at G 4c, and thus determine the V a s for the above decomposition of the code. 

It is worth noting here that the decomposition of C in Lemma 10 is not necessarily minimal. This is because 
one can have fewer q a s such that 

n = n p^- 

ie<rc[f] ie[£\ 

Since T^(q Qi ) = V(p ai ) = V ai , this would lead to a decomposition of C as a union of fewer V ai s. In contrast, 
the primary decomposition of Jc in Theorem [3] is irredundant, and hence none of the minimal primes can be 
dropped from the intersection. 
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Neural activity "motifs" and intervals of the Boolean lattice 



We can think of an element a £ {0, 1, *}" as a neural activity "motif". That is, a is a pattern of activity and 
silence for a subset of the neurons, while V a consists of all activity patterns on the full population of neurons 
that are consistent with this motif (irrespective of what the code is). For a given neural code C, the set of 
maximal oi, . . . ,ai £ Ac corresponds to a set of minimal motifs that define the code (here "minimal" is used 
in the sense of having the fewest number of neurons that are constrained to be "on" or "off" because a, 7^ *). 
If a € {0, *}", we refer to a as a neural silence motif, since it corresponds to a pattern of silence. In particular, 
silence motifs correspond to simplices in suppC, since suppV^ is a simplex in this case. If suppC is a simplicial 



complex, then Lemma 10 gives the decomposition of C as a union of minimal silence motifs (corresponding to 



facets, or maximal simplices, of suppC). 

More generally, V a corresponds to an interval of the Boolean lattice {0, l} n . Recall the poset structure of 
the Boolean lattice: for any pair of elements Vx, v<i £ {0, 1}™, we have v\ < v 2 if and only if supp(wi) C supp(i>2)- 
An interval of the Boolean lattice is thus a subset of the form: 

[«i," 2 ]= f {^{0,1}" \u 1 <v<u 2 }. 

Given an element a £ {0, 1, *}", we have a natural interval consisting of all Boolean lattice elements "compatible" 
with a. Letting a £ {0, l} n be the element obtained from a by setting all *s to 0, and a 1 £ {0, 1}™ the element 
obtained by setting all *s to 1, we find that 

V a = [a°,a 1 }={v£{0,l} n \a°<v<a 1 }. 

Simplices correspond to intervals of the form [O,*} 1 ], where is the bottom "all-zeros" element in the Boolean 
lattice. 

While the primary decomposition of Jc allows a neural code C C {0, 1}™ to be decomposed as a union of 



intervals of the Boolean lattice, as indicated by Lemma 10 the canonical form CF(Jc) provides a decomposition 
of the complement of C as a union of intervals. First, notice that to any pseudo-monomial / £ CF(Jc) we can 
associate an element b £ {0, 1, *} as follows: hi = 1 if Xi\f, bi = if (1 — Xj)\f, and b L = * otherwise. In other 
words, 



f = fi 



del' 



{t|fci=l} {j|6j=0> 

As before, b corresponds to an interval Vb = [b°, b 1 ] C {0, 1}™. Recalling the Jc is generated by pseudo-monomials 
corresponding to non-codewords, it is now easy to see that the complement of C in {0, 1}™ can be expressed as 
the union of V&S, where each b corresponds to a pseudo-monomial in the canonical form. The canonical form 



thus provides an alternative description of the code, nicely complementing Lemma 10 

1 fbk } • 



Lemma 11. C = {0, 1}" \ (Ji=i Vb t , where CF(J C ) = {f bl , 

We now illustrate both decompositions of the neural code with an 
example. 

Example. Consider the neural code C = {000, 001, 011, 111} C {0, l} 3 
corresponding to a set of receptive fields satisfying U\ C U2 C f/ 3 C X. 
The primary decomposition of Jc C F2[a;i, x%, X3] is given by 

(xi,x 2 ) n (xi,l - x 3 ) l~l (1 - x 2 ,l - x 3 ), 

while the canonical form is 

CF(J C ) = (xi(l - x 2 ) 1 x 2 (l - x 3 ),xi(l - x 3 )). 

From the primary decomposition, we can write C — V ai U V a2 U V a3 
for ai = 00*, a 2 =0*1, and 03 = *11. The corresponding Boolean lat- 



110 



100 




001 



000 



Figure 5: Boolean interval decomposi- 
tions of the code C = {000,001,011,111} 
(in black) and of its complement (in gray) , 
arising from the primary decomposition 



tice intervals are [000, 001], [001, 011], and [011, 111], respectively, and and canonical form of J c , respectively. 
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are depicted in black in Figure 5. As noted before, this decomposition 

of the neural code need not be minimal; indeed, we could also write C = V ai U V a3 , as the middle interval is not 
necessary to cover all codewords in C. 

From the canonical form, we obtain C = {0, l} 3 \(Vb 1 UVb 2 Ul4 3 ), where b\ = 10*, 6 2 = *10, and 63 = 1*0. The 
corresponding Boolean lattice intervals spanning the complement of C are [100, 101], [010, 110], and [100, 110], 
respectively; these are depicted in gray in Figure 5. Again, notice that this decomposition is not minimal - 
namely, V& 3 = [100, 110] could be dropped. 



5.3 An algorithm for primary decomposition of pseudo-monomial ideals 

We have already seen that computing the primary decomposition of the neural ideal Jq is a critical step towards 
extracting the canonical form CF(Jc), and that it also yields a meaningful decomposition of C in terms of neural 
activity motifs. Recall from Section |4~3] that J c is always a pseudo-monomial ideal - i.e., Jq is generated by 
pseudo-monomials, which are polynomials / € F2[sgj., . . . , x n ] of the form 

/ = Y\ z i> where Zj € {xi, 1 — Xi} for any i G [n]. 

In this section, we provide an explicit algorithm for finding the primary decomposition of such ideals. 

In the case of monomial ideals, there are many algorithms for obtaining the primary decomposition, and 
there are already fast implementations of such algorithms in algebraic geometry software packages such as 
Singular and Macaulay2 [25]. Pseudo-monomial ideals are closely related to square- free monomial ideals, but 
there are some differences which require a bit of care. In particular, if J C i^I^i, ■ ■ ■ , x n ] is a pseudo-monomial 
ideal and z G {x-i, 1 — x{\ for some i € [n], then for / a pseudo-monomial: 

fe(J,z)&fe J or /€(*). 

To see why, observe that x\ G (xi(l — X2), #2), because %\ = 1 • x\(\ — £2) + x\ ■ x%, but x\ is not a multiple 
of either x\(l — x%) or X2- We can nevertheless adapt ideas from (square-free) monomial ideals to obtain an 
algorithm for the primary decomposition of pseudo-monomial ideals. The following lemma allows us to handle 
the above complication. 

Lemma 12. Let J C F 2 [:ei, . . . , x n ] be a pseudo-monomial ideal, and let z G {a;.,, 1 — x{\ for some iE [n]. For 
any pseudo-monomial f, 

f G {J,z) =J> / G J or f G (z) or (1 - z)f G J. 



The proof is given in Section |6.5[ Using Lemma [12] we can prove the following key lemma for our algorithm, 
which mimics the case of square-free monomial ideals. 

Lemma 13. Let J G ¥2[x±, . . . , x n ] be a pseudo-monomial ideal, and let Yiiea z i ^ e a pseudo-monomial, with 
Zi G {xi, 1 — Xi} for each i. Then, 



The proof is given in Section 6.5 Note that if Jlie CT Zi ^ ^ ■> then this lemma implies J = C\ iea (J, Zi), which is 
the key fact we will use in our algorithm. This is similar to Lemma 2.1 in 25, Monomial Ideals Chapter], and 
suggests a recursive algorithm along similar lines to those that exist for monomial ideals. 

The following observation will add considerable efficiency to our algorithm for pseudo-monomial ideals. 

Lemma 14. Let J <zW%[xx, . . . , x n ] be a pseudo-monomial ideal. For any Z\ G {xi, 1 — Xi} we can write 

J = (zigi, . . . , Zig k , (1 - zi)fi, . . . , (1 - Zi)ft, hi,..., h m ), 

where the gj, fj and hj are pseudo-monomials that contain no Zi or 1 — Zj term. (Note that k,£ or m may be 
zero if there are no generators of the corresponding type.) Then, 

(J,Zi) = (J| Z4 =o,2i) = (Zi,fi,..-,fe,hi,...,h m )- 
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Proof. Clearly, the addition of Zi in (J, zi) renders the Zj^j generators unnecessary. The (1 — Zi)/j generators 
can be reduced to just fj because fj = 1 • (1 — Zi)fj + fj ■ z^. □ 

We can now state our algorithm. Recall that an ideal I C R is proper \i I ^ R. 
Algorithm for primary decomposition of pseudo-monomial ideals 

Input: A proper pseudo-monomial ideal J C F 2 [a; 1 , . . . ,x n ]. This is presented as J = (<?i, . . . ,g r ) with each 
generator gi a pseudo-monomial. 

Output: Primary decomposition of J. This is returned as a set V of prime ideals, satisfying J = f] IeV I- 

• Step 1 (Initializion Step): Set V = % and I? = {J}. Eliminate from the list of generators of J those that 
are multiples of other generators. 

• Step 2 (Splitting Step): For each ideal I £ D compute Dj as follows. 

Step 2.1: Choose a nonlinear generator ■ ■ ■ z im £ /, where each Zi £ {a^, 1 — Xi}, and m > 2. (Note: 
the generators of / should always be pseudo-monomials.) 



Step 2.2: Set Di = {{I, Zi t ), . . . , (I, z im }}. By Lemma 13 we know that 

m 

/= f](i,z ik )= n k. 

k=l KeDi 

• Step 3 (Reduction Step): For each Dj and each ideal (I, £ Dj, reduce the set of generators as follows. 

Step 3.1: Set = in each generator of /. This yields a "0" for each multiple of Zi, and removes 1 — Zi 
factors in each of the remaining generators. By Lemma 14 (/, z$) = (I\ Zi= a, zi). 

Step 3.2: Eliminate 0s and generators that are multiples of other generators. 

Step 3.3: If there is a "1" as a generator, eliminate (/, Zj) from D] as it is not a proper ideal. 

• Step 4 (Update Step): Update D and V, as follows. 

Step 4.1: Set D = (J Dj, and remove redundant ideals in D. That is, remove an ideal if it has the same 
set of generators as another ideal in D. 

Step 4.2: For each ideal I £ D, if I has only linear generators (and is thus prime), move / to V by setting 
V = V U / and D = D \ I. 

• Step 5 (Recursion Step): Repeat Steps 2-4 until D = 0. 

• Step 6 (Final Step): Remove redundant ideals of V . That is, remove ideals that are not necessary to 
preserve the equality J = H/e-p I- 

Proposition 2. This algorithm is guaranteed to terminate, and the final V is a set of irredundant prime ideals 
such that J — C\ Ie -p I ■ 

Proof. For any pseudo-monomial ideal I £ D, let deg(/) be the sum of the degrees of all generating monomials 
of /. To see that the algorithm terminates, observe that for each ideal (I,Zi) £ D], deg((I, Zi)) < deg(7) (this 
follows from Lemma 14). The degrees of elements in D thus steadily decrease with each recursive iteration, 
until they are removed as prime ideals that are appended to V . At the same time, the size of D is strictly 
bounded at \D\ < 2W, since there are only Q) pseudo-monomials in ¥ 2 [xi, . . . ,x n ), and thus at most 2(3) 
distinct pseudo-monomial ideals. 

By construction, the final V is an irredundant set of prime ideals. Throughout the algorithm, however, it is 
always true that J = {f\ IeD I) H (C\iev -0- Since the final D = 0, the final V satisfies J = C\iev ^- ^ 
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6 Appendix 1: Proofs 
6.1 Proof of Lemmas |3] and H] 

To prove Lemmas [3] and [4j we need a version of the Nullstellensatz for finite fields. The original "Hilbert's 
Nullstcllcnsatz" applies when k is an algebraically closed field. It states that if / G k[xx, . . . ,x n ] vanishes on 
V(J), then / e \/J. In other words, 

i(v(j)) = Vj. 

Because we have chosen k = F2 = {0, 1}, we have to be a little careful about the usual ideal- variety correspon- 
dence, as there are some subtleties introduced in the case of finite fields. In particular, J = \J~J in F 2 [xi, . . . , x n ] 
does not imply I(V(J)) = J. 

The following lemma and theorem are well-known. Let ¥ q be a finite field of size q, and ¥ q [x\, . . . , x n \ the 
n-variate polynomial ring over ¥ q . 

Lemma 15. For any ideal JCFjii,..., x n ], the ideal J + (xf — x±, . . . , x^ — x n ) is a radical ideal. 

Theorem 4 (Strong Nullstellensatz in Finite Fields). For an arbitrary finite field ¥ q , let J C.¥ q [xi, ... , x n ] be 
an ideal. Then, 

I(V(J)) = J+(x q 1 -x 1: ...,xl-x n ). 

Proof of Lemma [3] 

We begin by describing the maximal ideals of F2[ari, . . . , x n ]. Recall that 

m v d = I(v) = {/ G ¥ 2 [x u . . . , x n ] I f(v) = 0} 

is the maximal ideal of¥2[x%,..., x n ] consisting of all functions that vanish on v £ F£ . We will use the notation 
fh v to denote the quotient of m v in Rq , in cases where m v D Iq . 

Lemma 16. m v = (x\ — v%, . . . , x n — v n ) C Fa[a;i, . . . , x n ], and is a radical ideal. 

Proof. Denote A v = (xi—vi, . . . , x n — v n ), and observe that V(A V ) = {v}. It follows that I(V(A V )) = I(v) = m v . 
On the other hand, using the Strong Nullstcllcnsatz in Finite Fields we have 

I{V(A V )) = A v + (xj - x 1} . . . ,xl - x n ) = A v , 

where the last equality is obtained by observing that, since Vi G {0, 1} and i(l — Xi), each generator 

of {x\ — Xx, . . . ,Xn — x n ) is already contained in A v . We conclude that A v = m v , and the ideal is radical by 
Lemma [15] □ 

In the proof of Lemma[3j we make use of the following correspondence: for any quotient ring R/I, the maximal 
ideals of R/I are exactly the quotients m = m/I, where m is a maximal ideal of R that contains / [26] . 

Proof of Lemma^ First, recall that because Rc is a Boolean ring, Spec(i?e) = maxSpec(i?c)j the set of all 
maximal ideals of Rc ■ We also know that the maximal ideals of F2 [ exactly those of the form m v 

for v £ ¥2- By the correspondence stated above, to show that maxSpec(i?c) = {™u | v G C} it suffices to show 
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m v D Ic if and only if v G C. To see this, note that for each v G C, Ic C m„ because, by definition, all elements 
of Ic are functions that vanish on each v € C. On the other hand, if v (fc C then m v J> Ic; va. particular, the 
characteristic function p v G Ic for v C, but p v m v because p v (v) = 1. Hence, the maximal ideals of Rc are 
exactly those of the form fh v for v G C. □ 

We have thus verified that the points in Spec (Rc) correspond to codewords in C. This was expected given 
our original definition of the neural ring, and suggests that the relations on F2[xi,... ,x n ] imposed by Ic are 
simply relations ensuring that V(rh v ) — for all v ^ C. 

Proof of Lemma [4] 

Here we find explicit relations for Ic in the case of an arbitrary neural code. Recall that 

n 

p v = J[((Xi-Vi)-l)= Yl X i II 

i=l {i\vi = l} {j\v j= 0} 

and that p v (x) can be thought of as a characteristic function for v, since it satisfies p v (v) — 1 and p v (x) = for 
any other a; G FJ. This immediately implies that 

V(Jc) = V({{ Pv \v£C}))=C. 

We can now prove Lemma [4j 

Proof of Lemma^ Observe that I c = 1(C) = I(V(J e )), since V(Jc) — C. On the other hand, the Strong 
Nullstellensatz in Finite Fields implies I(V(Jc)) — Jc + ( x \ — xi, . . . , x^ — x n ) = Jc + B. □ 

6.2 Proof of Theorem [T] 

Recall that for a given set of receptive fields U = {Ui, . . . , U n } in some stimulus space X, the ideal In C 
Fa [sci , . . . , x n ] was defined as: 

The Boolean relations are present in In irrespective of II , as it is always true that Ui C Ui and this yields the 
relation Xi(l — Xi) for each i. By analogy with our definition of Jc, it makes sense to define an ideal Ju which 
is obtained by stripping away the Boolean relations. This will then be used in the proof of Theorem [l] 

Note that if a n r ^ 0, then for any i G a n r we have U a C Ui C {Jj eT Ui, and the corresponding relation 
is a multiple of the Boolean relation Xi(l — X{). We can thus restrict attention to relations in In that have 
a n r = 0, so long as we include separately the Boolean relations. These observations are summarized by the 
following lemma. 

Lemma 17. In = Ju + {x\ — x\, . . . , x\ — x n ), where 

Ju = f ({x* Y[(l ~ Xi) | a n r = and U a C \J Ui}). 

Proof of Theorem^ We will show that = Jc(M) (and thus that Iu = Ic{U)) by showing that each ideal 
contains the generators of the other. 

First, we show that all generating relations of Jc(u) are contained in Jy. Recall that the generators of Jc(u) 
are of the form 

Pv = n x * n t 1 - x i) f ° r w ^ 

itEsupp(i;) i^supp(v) 

If pu is a generator of Jc(u)i then w ^ and this implies (by the definition of C(U)) that U supp ^ C 

Uj^ S upp(t;) ^j'- Taking cr = supp(w) and r = [n] \ supp(u), we have U a C U JlET f/j with cr n t = 0. This in turn 
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tells us (by the definition of Ju) that x a IXjer(l — xj) is a generator of Ju- Since p v — x a Y\j &T {l — Xj) for our 
choice of a and r, we conclude that p v € Ju- Hence, Jc(u) 5= Ju- 

Next, we show that all generating relations of Ju are contained in Jq(u)- 11 Ju has generator x a Y\ ieT {^ — Xi), 
then U a C [J ier Ui and <t P\ t — 0. This in turn implies that f] iea U \ {Jj er Uj — 0, and thus (by the 
definition of C(U)) we have v C(U) for any v such that supp(t>) D a and supp(w) n r = 0. It follows that 
Jc(u) contains the relation x supp (.„) lljgsupp('u)(l — x i) f° r an y such v. This includes all relations of the form 
x " IT/erC 1 ~ x j) Ilfc^o-UT p ki where P k e {x fe , 1 - x k }. Taking / = x a ]\ jeT {l - xj) in Lemma 18 (below), we 



can conclude that Jc(u) contains IX/ex^ — x j)- Hence, Ju Q Jc(U)- D 
Lemma 18. For any f e fc[xi, . . . ,x n ] and t C [n], the ideal ({fYiier Pi \ Pi € { x ii 1 — x i}}) = (/)• 

Proof. First, denote J/(t) = ({fl\ier P i I P * e {^i, 1 ~ x i}})- We wish to prove that Z/(r) = (/), for any 
r C [n]. Clearly, 7/(t) C (/), since every generator of Z/(r) is a multiple of /. We will prove 7/(t) D (/) by 
induction on |t|. 

If |r| = 0, then r = and 7/(t) = (/). If |r| = 1, so that r = {z} for some i <G [n], then 7/(t) = 
(/(l -Xi),fXi). Note that /(l - a;*) + /a* = /, so / € 7/(r), and thus //(r) D (/). 

Now, assume that for some I > 1 we have //(c) D (/) for any a C [n] with |cr| < £ If ^ > n, we are done, so 
we need only show that if £ < n, then 1/(t) 2 (/) for any r of size £ + 1. Consider r C [n] with |r| = £ + 1, and 
let j G t be any element. Define t' = r\{j}, and note that |r'| = £ By our inductive assumption, If(r') 3 (/). 
We will show that 7/(t) 3 7/(t'), and hence 7/(t) D (/). 

Let <? = /riier' P « he any generator of Ij(t') and observe that both /(l — Xj) Yl ier i Pi and /xj Yl ieT i Pi are 
both generators of I/(t). It follows that their sum, g, is also in If(r), and hence <? £ 7/(t) for any generator g 
of If(T r ). We conclude that 2/(r) 2 Z/(r'), as desired. □ 

6.3 Proof of Theorem [2] 

We begin by showing that Ju, first defined in Lemma [T7] can be generated using the Type 1, Type 2 and Type 
3 relations introduced in Section 4.2 From the proof of Theorem [T] we know that Ju = Jc(u)> so the following 



lemma in fact shows that Jc(u) is generated by the Type 1, 2 and 3 relations as well. 
Lemma 19. For IA = {U\, ■ ■ ■ , U n } a collection of sets in a stimulus space X , 

Ju = <{x ff |C7 CT = 0},{TJ(l-x i )|Xc|JC7 i } ! 

(avJJCl-a*) | ct,t^0, anr = 0, 17, ^ 0, |J U % ± X, and XJ a C |J CT ( }>. 

(equivalently, Jc{u)) * s generated by the Type 1, Type 3 and Type 2 relations, respectively. 
Proof. Recall that in Lemma [17| we defined Ju as: 

Ju = {{x* Y[(l - x t ) | a n r = and f/ CT C |J Ui}). 



Observe that if C/ CT = 0, then we can take r = to obtain the Type 1 relation x a , where we have used the fact 
that IlieBCl — x i) — 1- Any other relation with U a = and r ^ would be a multiple of x CT . We can thus write: 

Ju = {{xa I U a = 0}, {x ff J](l - x,) | r ^ 0, a n r = 0, U a ^ 0, and U„ C (J [/,}). 

Next, if cr = in the second set of relations above, then we have the relation Y\ i£T (1— x.;) with U$ = X C. [J ieT U. 
Splitting off these Type 3 relations, and removing multiples of them that occur if U igr Ui — X, we obtain the 
desired result. □ 
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Next, we show that Ju can be generated by reduced sets of the Type 1, Type 2 and Type 3 relations given 
above. First, consider the Type 1 relations in Lemma |19| and observe that if r C a, then x a is a multiple of 
x T . We can thus reduce the set of Type 1 generators needed by taking only those corresponding to minimal a 
with U a = 0: 

({x a | U a = 0}) = ({x a | a is minimal w.r.t. U a = 0})- 
Similarly, we find for the Type 3 relations: 

({ n^ 1 - **) i x ^ u u *}) = a n^ 1 - **) i r is mmimai w - r -t- x c u u^. 

Finally, we reduce the Type 2 generators. If p C a and x p Y\ i( z T (1 — Xi) G J^, then we also have x a W_nz T {^^ %i) € 
Jil. So we can restrict ourselves to only those generators for which a is minimal with respect to U a C lJ ieT f/j. 
Similarly, we can reduce to minimal r such that U a C U i(ET f/j. In summary: 

II^ - «*) I ff,T ?6 0, <r n r = 0, I7 a ^ 0, (J CTj ^ X, and U a C |J [/*}) = 
({i.^l-ii) | a,r^0, (jnT = 0, C/ CT ^0, |JC/i^X, and cr, t are each minimal w.r.t. U a C t/j}). 



We can now prove Theorem [2j 

Proof of Theorem^ Recall that C = C(U), and that by the proof of Theorem [l] we have Jc(u) = Ju- By the 
reductions given above for the Type 1, 2 and 3 generators, we also know that Ju can be reduced to the form 
given in the statement of Theorem [2] We conclude that Jc can be expressed in the desired form. 

To see that Jc, as given in the statement of Theorem [2j is in canonical form, we must show that the given set 
of generators is exactly the complete set of minimal pseudo- monomials for Jq. First, observe that the generators 
are all pseudo-monomials. If x a is one of the Type 1 relations, and x a £ (g) with (x a ) ^ (g), then g = Yiier Xi 
for some tCu. Since U T ^= 0, however, it follows that g ^ Jc a. n d hence x a is a minimal pseudo-monomial of 
Jc- By a similar argument, the Type 2 and Type 3 relations above are also minimal pseudo- monomials in Jc- 

It remains only to show that there are no additional minimal pseudo- monomials in Jq. Suppose / = 
x CT rj igr (l — Xi) is a minimal pseudo-monomial in Jc- By Lemma [5j U a C {J ier Uj and a n t — 0, so / is 
a generator in the original definition of Ju (Lemma 17). Since / is a minimal pseudo- monomial of Jc, there 
does not exist a g G Jc such that g = x a i Yiier'i^ ~ x i) w hh either a' C a or r' C r. Therefore, a and r are 
each minimal with respect to U c C [J ieT Ui- We conclude that / is one of the generators for Jc given in the 
statement of Theorem [2| It is a minimal Type 1 generator if r = 0, a minimal Type 3 generator if a = 0, and 
is otherwise a minimal Type 2 generator. The three sets of minimal generators are disjoint because the Type 1, 
Type 2 and Type 3 relations are disjoint, provided X ^ 0. □ 



6.4 Proof of Proposition [T] 

Note that every polynomial obtained by the canonical form algorithm is a pseudo-monomial of Jc- This is 
because the algorithm constructs products of factors of the form Xi or 1 — Xi, and then reduces them in such a 
way that no index is repeated in the final product, and there are no powers of any Xi or 1 — xi factor; we are 
thus guaranteed to end up with pseudo-monomials. Moreover, since the products each have at least one factor 
in each prime ideal of the primary decomposition of Jc , the pseudo-monomials are all in Jc ■ Proposition [l] 
states that this set of pseudo- monomials is precisely the canonical form CF(Jc)- 

To prove Proposition [l] we will make use of the following technical lemma. Here z i: t/i € {x i: 1 — x{\, and 
thus any pseudo-monomial in F2[sci, • • • , x n ] is of the form Yijea z j f° r s °nie index set a C [n]. 

Lemma 20. If yi 1 - ■ ■ yi m G (zj 1 , . . . , Zj t ) where {ik} and {j r } are each distinct sets of indices, then yi k — Zj r 
for some k G [m] and r G [£]. 

Proof Let / = y h ■ ■ ■ y im and P = { Zjl ,. . . , z jt }. Since / G (P) , then (P) = (P, /), and so V((P)) = V((P, /)). 
We need to show that yi k — Zj r for some pair of indices ik,jr- Suppose by way of contradiction that there is no 
ik,j r such that y ik = z jr . 
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Select a £ {0, 1}™ as follows: for each j r £ {ji , . . . , ji}, let a Jr = if zj r — Xj r , and let aj r — 1 if Zj r = 1 



- x 



when evaluating at a, we thus have Zj r (a) = for all r £ [£]. Next, for each if. £ w = . . . , i m }\{ji, ■■li^li 
let a ik — 1 if y ik = x ik , and let a ik = if y ik = 1 - x ik , so that y ik {a) = 1 for all i k £ ui. For any 
remaining indices t, let a t = 1. Because we have assumed that yi k ^ Zj r for any ik,jr pair, we have for any 
i £ {h, . . . ,i m } n {ji, . . . that yi(a) = 1 - Zi(a) = 1. It follows that /(a) = 1. 

Now, note that a £ V((P)) by construction. We must therefore have a £ V((P, /)), and hence f(a) = 0, a 
contradiction. We conclude that there must be some ik,j r with y ik — Zj r , as desired. □ 

We can now prove the Proposition. 

Proof of Proposition^ It suffices to show that after Step 4 of the algorithm, the reduced set Ai(Jc) consists 
entirely of pseudo-monomials of Jc, and includes all minimal pseudo-monomials of Jc- If this is true, then 
after removing multiples of lower-degree elements in Step 5 we are guaranteed to obtain the set of minimal 
pseudo-monomials, CF(Jc), since it is precisely the non-minimal pseudo-monomials that will be removed in the 
final step of the algorithm. 

Let Jc = f]i—i Pi be the primary decomposition of Jc, with each Pi a prime ideal of the form Pi = 
(zj 1 , . . . , Zj e ). Recall that AA{Jc), as defined in Step 3 of the algorithm, is precisely the set of all polynomials g 
that are obtained by choosing one linear factor from the generating set of each Pj: 

Ai(Jc) = {g = z pi ■ ■ ■ z p ^ | z p . is a linear generator of Pi}. 

Furthermore, recall that M(Jc) is obtained from A4(Jc) by the reductions in Step 4 of the algorithm. Clearly, 
all elements of M(Jc) are pseudo-monomials that are contained in Jc- 

To show that M(Jc) contains all minimal pseudo- monomials of Jc, we will show that if / £ Jc is a pseudo- 
monomial, then there exists another pseudo- monomial h £ A4(Jc) (possibly the same as /) such that h\f. 
To see this, let / = y il ■■■yi m be a pseudo-monomial of Jc- Then, f £ Pi for each i £ [s]. For a given 



Pi = (zj 1 , ... ,Zj e ), by Lemma 20 we have yi k — Zj r for some k £ [m] and r £ [£]. In other words, each prime 
ideal Pj has a generating term, call it z Pi , that appears as one of the linear factors of /. Setting g = z pi ■ ■ ■ z Ps , 
it is clear that g £ M(Jc) and that either g\f, or z p . — z p . for some distinct pair i,j. By removing repeated 
factors in g one obtains a pseudo-monomial h £ A4(Jc) such that h\g and h\f. If we take / to be a minimal 
pseudo-monomial, we find / = h £ M(Jc)- □ 



6.5 Proof of Lemmas [12] and 1131 

Here we prove Lemmas |12| and |13[ which underlie the primary decomposition algorithm. 

Proof of Lemma \T^ Assume / £ (J, z) is a pseudo-monomial. Then / = z^z^ ■ ■ ■ Zi r , where Zi £ {xi, 1 — Xi} 
for each i, and the if. are distinct. Suppose / ^ (z). This implies Zi k ^ z for all factors appearing in /. We will 
show that either / £ J or (1 — z)f £ J. 

Since J is a pseudo-monomial ideal, we can write 

J = (zgi, zg k , (1 - z)fi, . . . , (1 - z)fi, hi,..., h m ), 

where the gj, fj and hj are pseudo- monomials that contain no z or 1 — z term. This means 

k I m 

/ = z h z i2 ■■■z ir =z^2 u j9j + (1 - z ) ^2 v jfj + X] w J h i + yz > 

7=1 J=l J=l 

for polynomials Uj, Vj, Wj, and y €Wz[xi, . . . , x n ]. Now consider what happens if we set z = in /: 

/ TCI 

f\z=Q = Z h Z i2 ■ ■ ■ Z ir \ z=Q = J^Vjlz^ofj + }]uij\g=ohj. 

j=l J'=l 
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Next, observe that after multiplying the above by (1 — z) we obtain an element of J: 

l m 

(1 - z)f\ z=Q = (1 - z)J2 v j\z=ofj + (1 - z)J2 w j\z=ohj G J, 

since (1 — z)/j 6 J for j = 1, . . . , I and hj G J for j = 1, . . . , m. There are two cases: 

Case 1: If 1 — z is a factor of /, say z^ = 1 — z, then / | 2= o = Zj 2 • • • z ir , and thus / = (1 — z)/| z=0 € J. 

Case 2: If 1 — z is not a factor of /, then / = f\ z= o- Multiplying by 1 — z we obtain (1 — z)f G J. 

We thus conclude that / ^ (z) implies / G J or (1 — z)/ G J. □ 

Proof of Lemma [Tg[ Clearly, (J, z a ) C Hiecr^ 2 ^)- To see the reverse inclusion, consider / 6 Hiecr^ 2 ^)- We 
have three cases. 

Case 1: / € J. Then, / G (J, z CT ). 

Case 2: / ^ J, but / G (z^) for all i E a. Then / G (z<r), and hence / € (J, z a ). 

Case 3: / ^ J and / ^ (zj) for all i € r C cr, but / € (zj) for all j e ct \ r. Without loss of generality, we can 



rearrange indices so that r = {1, . . . ,m} for m > 1. By Lemma 12 we have (1 — zi)f G J for all i € r. 
We can thus write: 

/ = (1 - Zl)/ + «l(l - Z2)/ + • • • + Zl ■ ■ ■ - + • • • Z m /. 

Observe that the first m terms are each in J. On the other hand, / € (zj) for each j E o~\t implies that 
the last term is in (z r ) n (z a \ T ) = (z a ). Hence, / G (J, z^). 

We may thus conclude that f] ietJ (J, Zi) C (J, z CT ), as desired. □ 
6.6 Proof of Theorem |3] 

Recall that Jq is always a proper pseudo- monomial ideal for any nonempty neural code C C {0, 1}™. Theorem[3] 
is thus a direct consequence of the following proposition. 

Proposition 3. Suppose J C F2[xi, . . . , x n ] is a proper pseudo-monomial ideal. Then, J has a unique irredun- 
dant primary decomposition of the form J = H a e^l P a > w ^ ere {Pa}aeA are the minimal primes over J . 

Proof. By Proposition [2j we can always (algorithmically) obtain an irredundant set V of prime ideals such that 
J = H/e-p Furthermore, each I € V has the form I = (z^ , . . . , Z\ h ), where Zi € {xi ,1 — Xi} for each i. Clearly, 
these ideals are all prime ideals of the form p a for a e {0,1,*}. It remains only to show that this primary 
decomposition is unique, and that the ideals {p a }aeA are the minimal primes over J. This is a consequence of 



some well-known facts summarized in Lemmas [21] and 22 below. First, observe by Lemma 21 that J is a radical 



ideal. Lemma [22] then tells us that the decomposition in terms of minimal primes is the unique irredundant 
primary decomposition for J. □ 

Lemma 21. If J is the intersection of prime ideals, J = [L=i Pii then J is a radical ideal. 

Proof. Suppose p n G J. Then p n G Pi for all i G [£}, and hence p G Pi for all i G [£]. Therefore, p G J. □ 

The following fact about the primary decomposition of radical ideals is true over any field, as a consequence 
of the Lasker-Noether theorems [23 pp. 204-209]. 

Lemma 22. If J is a proper radical ideal, then it has a unique irredundant primary decomposition consisting 
of the minimal prime ideals over J. 
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7 Appendix 2: Neural codes on three neurons 



Label 


Code C 


Canonical Form CF(Jc) 


Al 


000,100,010,001,110,101,011,111 


(h 

V 






A2 


000,100,010,110,101,111 


2=3(1 — x i) 






A3 


000,100,010,001,110,101,111 


2; 2 X 3 (1 ~ Xl) 






A4 


000,100,010,110,101,011,111 


^3(1 — — x 2 ) 






A5 


000,100,010,110,111 


2=3V 1 x i), x 3\ l x 2) 






A6 


000,100,110,101,111 


x 2 {l - xi), x 3 (l - xi) 






A7 


000,100,010,101,111 


x 3 {l - xi), xix 2 (l - x 3 ) 






A8 


000,100,010,001,110,111 


XlX 3 (l - x 2 ), x 2 x 3 (l - Xl) 






A9 


000 100 001 110 011 111 


x 3 {l - x 2 ), x 2 (l - xi)(l - x 3 ) 






A10 


000,100,010,101,011,111 


x 3 (l - Xi)(l - X 2 ), XiX 2 (l - x 3 ) 






All 


000,100,110,101,011,111 


x 2 {l - xi)(l - x 3 ), x 3 (l - xi)(l - x 2 ) 






A12 


000,100,110,111 


x 3 {l - xi), x 3 (l - x 2 ), x 2 (l - Xi) 






A13 


000,100,010,111 


x 3 (l - xi), x 3 (l - x 2 ), xix 2 (l - x 3 ) 






A14 


000,100,010,001,111 


XlX 2 (l - X 3 ), X 2 X 3 (1 - Xl), XlX 3 (l - x 2 ) 






A15 


000,110,101,011,111 


xi(l - x 2 )(l - x 3 ), x 2 (l - xx)(l - x 3 ), x 3 (l - xi)(l - 


- Toi 
x 2) 


A16* 


000,100,011,111 


3=2(1 - x 3 ), x 3 (l - x 2 ) 






A17* 


000,110,101,111 


x 2 {l - Xl), X 3 (l - Xl), Xl(l - x 2 )(l - x 3 ) 






A18* 


000,100,111 


2=2(1 - Xl), x 2 (l - X 3 ), X 3 (l - Xi), x 3 (l - 


x 2 ) 




A19* 


000,110,111 


2=3(1 - Xi), x 3 (l - X 2 ), Xl(l - x 2 ), x 2 (l - 


Xl) 




A20* 


000,111 


2=1(1 - x 2 ), x 2 (l - x 3 ), x 3 (l - xi), xi(l - 


2=3), 2:2(1 - 


■ Xl ^ Tr> f 1 — Tn\ 
^1 / , -^3 V 2 J 


Bl 


000,100,010,001,110,101 


2= 2 X 3 






B2 


000,100,010,110,101 


X 2 X 3 , X 3 (l - Xl) 






B3 


000,100,010,101,011 


xix 2 , x 3 (l - xi)(l - x 2 ) 






B4 


000,100,110,101 


2= 2 X 3 , X 2 (l - Xl), X 3 (l - Xl) 






B5 


000,100,110,011 


XlX 3 , x 3 (l - x 2 ), x 2 (l - Xl)(l - x 3 ) 






B6* 


000,110,101 


X 2 X 3 , X 2 (l - Xi), X 3 (l - Xi), Xi(l - x 2 )(l 


- 2= 3 ) 




CI 


000,100, 010,001, 110 


XiX 3 , X 2 X 3 






C2 


000,100,010,101 


XlX 2 , x 2 x 3 , x 3 (l - Xl) 






C3* 


000,100,011 


xix 2 , xix 3 , x 2 (l - x 3 ), x 3 (l - x 2 ) 






Dl 


000,100,010,001 


xix 2 , x 2 x 3 , xix 3 


El 


000,100,010,001,110,101,011 


2=lX 2 X 3 






E2 


000,100,010,110,101,011 


XlX 2 X 3 , X 3 (l - Xl)(l - x 2 ) 






E3 


000,100,110,101,011 


XlX 2 X 3 , x 2 (l - Xl)(l - x 2 ), x 3 (l - Xl)(l - 


-x 2 ) 




E4 


000,110,011,101 


xix 2 x 3 , xi(l - x 2 )(l - x 3 ), x 2 (l - xi)(l - 


- x 3 ), x 3 (l 


- xi)(l - x 2 ) 


Fl* 


000,100,010,110 


2=3 






F2* 


000,100,110 


2=3, 2; 2 (1 - Xi) 






F3* 


000,110 


2=3, 2=l(l - X 2 ), X 2 (l - Xi) 






Gl* 


000,100 


2= 2 , X 3 


HI* 


000 


Xl, x 2 , x 3 


11* 


000,100,010 


X 3 , XiX 2 



Table 1: Forty permutation-incquivalent codes, each containing 000, on three neurons. Labels A-I indicate the various 
families of Type 1 relations present in CF(Jc), organized as follows (up to permuation of indices): (A) None, (B) 
{2:12:2}, (C) {x 1 x 2 ,X2X 3 }, (D) {2:12:2, 2:22:3, £12-3}, (E) {2:12:22:3}, (F) {xi}, (G) {2:1,2:2}, (H) {2:i,X2,x 3 }, (I) {2:1,2:22:3}. 
All codes within the same A-I series share the same simplicial complex, A(C). The *s denote codes that have Ui = 
for at least one receptive field (as in the F, G, H and I series) as well as codes that require Ui = 172 or Ui = U2 U U3 
(up to permutation of indices); these are considered to be highly degenerate. The remaining 27 codes are depicted with 
receptive field diagrams (Figure 6) and Boolean lattice diagrams (Figure 7). 



2G 




A2 




A3 





A5 




A6 




A7 
1 



A8 







A11 



A12 



A13 



A14 



A15 








B2 





B4 



B5 non-convex 




C1 



C2 



D1 





O 

DO, 



E1 





E3 non-convex 



E4 non-convex 





Figure 6: Receptive field diagrams for the 27 non-* codes on three neurons listed in Table 1. Codes that admit 
no realization as a convex RF code are labeled "non-convex." The code E2 is the one from Lemma [2j while 
Al and A12 are permutation-equivalent to the codes in Figure 3A and 3C, respectively. Deleting the all-zeros 
codeword from A6 and A4 yields codes permutation-equivalent to those in Figure 3B and 3D, respectively. 
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011 




000 




011 



001 



000 




000 




011 



001 



000 




011 



001 



000 




011 



001 



000 




011 



001 




011 



001 



000 



000 




A10 



011 



001 



000 




011 



001 



000 




011 



001 



000 




011 



001 




011 



001 



000 



000 




011 



001 




011 



001 



000 



000 




011 



001 



000 




000 




011 



001 




011 



001 



000 



000 




011 



001 



000 




011 



001 




011 



001 



000 



000 




011 



001 



000 




011 



001 




011 



001 



000 



000 




011 



011 



001 



000 




000 



Figure 7: Boolean lattice diagrams for the 27 non-* codes on three neurons listed in Table 1. Interval decompo- 



sitions (see Section 5.2 1 for each code are depicted in black, while decompositions of code complements, arising 



from CF(Jc), are shown in gray. Thin black lines connect elements of the Boolean lattice that are Hamming 
distance 1 apart. Note that the lattice in A12 is permutation-equivalent to the one depicted in Figure 5. 
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